Real-Time Depth Video-Based Rendering for 6-DoF HMD Navigation and Light Field Displays

This paper presents a novel approach to provide immersive free navigation with 6 Degrees of Freedom in real-time for natural and virtual scenery, both static dynamic content. Stemming from the state-of-the-art Depth Image-Based Rendering OpenGL pipeline, this new View Synthesis method achieves at up 90 FPS can take any number input views their corresponding depth maps as priors. Video content be played thanks GPU decompression, supporting full parallax real-time. To render viewpoint, each selected view is warped using camera pose associated map, an implicit 3D representation. The are then blended all together generate chosen view. Various blending approaches specifically designed avoid visual artifacts compared. Using few four appears optimal trade-off between computation time quality, allowing synthesize high-quality stereoscopic real-time, offering genuine reality experience. Additionally, proposed provides rendering scenery on holographic light field displays. Our results comparable - objectively subjectively state art synthesis tools NeRF LLFF, while maintaining overall lower complexity rendering.